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DETAILED ACTION 

1 . This communication is in response to Remarks, filed 02/09/2007. 

2. Claims 35, 37-3.9, 41-45, 47, 51, and 1 13 are pending. 

3. The allowable subject matter included in cancelled claim 49 has been withdrawn in view 
of updated search. 

Allowable Subject Matter 

4. The indicated allowability in cancelled claim 49, and thus amended claim 35, is 
withdrawn in view of the newly discovered reference(s) to Takebayashi et al. (5,577,165). 
Rejections based on the newly cited reference(s) follow. 

Claim Rejections - 35 USC §103 

5. The following is a quotation of 35 U.S. C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 102 of this title, if 
the differences between the subject matter sought to be patented and the prior art are such that the subject matter as a whole would 
have been obvious at the time the invention was made to a person having ordinary skill in the art to which said subject matter pertains. 

Patentability shall not be negatived by the manner in which the invention was made. 

6. Claims 35, 37-39, 41-45, 47, 51, and 113 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Rueda (6,157,727) in view of Takebayashi et al. (5,577,165). 

As to claim 35, Rueda teaches 
A prosthetic hearing device (hearing aid, col. 2 lines 56-60) comprising: 
a sensor for detecting a speech (microphone, col. 3 lines 1-10); 
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a speech recognition processor that performs speech recognition on the detected speech 
(col. 3 lines 23-26); 

wherein the speech recognition processor performs speech recognition in view of at least 
one of a physical state of the user and an operating condition of the prosthetic hearing device 
(col. 1 lines 53-56); 

an output device (output transducer, Abstract) that outputs generated speech to the user 

a speech generator (speech recognizer and processor, Fig. 1 and ). 

Rueda does not teach a speech generator that analyzes results of speech recognition to 
comprehend a semantic meaning in the detected speech and transforms the detected speech into a 
speech having a speech form assistive in understanding the semantic meaning in the detected 
speech; a memory that has stored a library of images compressing still and motion pictures, 
symbols, characters, notes, photos, animations, illustrations, voice spectrum patterns and colors, 
wherein the speech generator selects at least one image associated with the semantic meaning in 
the detected speech; and a display that displays the selected at least one image associated with 
the semantic meaning in the detected speech. 

However, Takebayashi et al. do teach a speech generator that analyzes results of speech 
recognition to comprehend a semantic meaning in the detected speech and transforms the 
detected speech into a speech having a speech form assistive in understanding the semantic 
meaning in the detected speech (col. 6 lines 44-50); 

a memory that has stored a library of images compressing still and motion pictures (col. 
18 lines 27-37), symbols (text, col. 7 lines 25-38), characters (text, col. 7 lines 25-38), notes 
(text, col. 7 lines 25-38), photos (animated picture, col. 18 line 33), animations (col. 18 lines 31- 
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34), illustrations (human character image, col. 18 lines 35-39), voice spectrum patterns (Fig. 3) 
and colors (col. 25 lines 14-16), wherein the speech generator selects at least one image 
associated with the semantic meaning in the detected speech (col. 7 lines 23-31 and col. 6 lines 
44-50); and 

a display that displays the selected at least one image associated with the semantic 
meaning in the detected speech (col. 7 lines 30-37). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to implement Takebayashi et al. semantic recognition into Rueda 5 s speech generator 
system in order to provide a speech dialogue system for improving human-computer interaction, 
because in conventional speech dialogue system, the speech response is usually given by a 
mechanical voice reading obtained by a text composition without any modulation of speech tone, 
so that it has often been difficult for the user to hear the message, (Takebayashi et al., Abstract 
and col. 2 lines 23-34). 

As to claim 37, which depends on claim 35, Rueda teaches 

a speech recognition generator processor performs at least one of speaker recognition 
(speech recognizer and processor, Fig. 1). 

Rueda does not teach a speech generator generates the speech representing results of the 
recognition. 

However, Takebayashi et al. teach a speech generator generates the speech representing 
results of the recognition (speech understanding unit, col. 8 lines 25-45). 
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Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to implement Takebayashi et al. recognition into Rueda's speech generator system in 
order to provide high speech understanding of the almost freely uttered speech by using very 
little restrictions regarding the manner of speech utterance imposed on the user (Takebayashi et 
al., Abstract and col. 8 lines 25-30). 

As to claim 38, which depends on claim 35, Rueda teaches 
A prosthetic hearing device wherein the speech recognition processor transforms detected speech 
in view of at least one of a an operating condition of the prosthetic hearing device and a purpose 
for use of the device by the user (language translation, Abstract and col. 3 lines 20-29). 

As to claim 40, which depends on claim 35, Rueda teaches 
wherein the speech generator transforms the detected speech by adding thereto a 
modifying language (language translation, Abstract). 

As to claim 41, which depends on claim 35, Rueda teaches 
wherein the speech generator reproduces a speech previously produced when it 
determines the results from the speech recognition that it is necessary to reproduce the previously 
produced speech (col. 3 lines 1-10 and 20-27 and col. 1 lines 1-24; necessary storing 
information, thus able to reproduce it via speech generator) 

As to claim 42, which depends on claim 35, Rueda teaches 
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wherein the speech generator reproduces speech previously produced when it determines 
from the result of the speech recognition that it is necessary to reproduce the previously 
produced speech (col. 1 lines 1-10 and 20-28). 

As to claim 43, which depends on claim 35, Rueda teaches 

the speech data generator controls an output rate of the speech data (col. 3 lines 20-28). 

As to claim 44, which depends on claim 36, Rueda teaches 

the output device outputs the speech using a sample speech data synthesized by the 

speech generator (col. 3 lines 1-10 and 20-27; necessary in the translating process is a speech 

synthesized from a speech generator). 

As to claim 45, which depends on claim 35, Rueda teaches 
a memory that has stored samples of speech data (Abstract, necessary in translating process), 
wherein the output device outputs the sound speech data using sample speech data selected by 
the speech data generator from the memory (col. 3 lines 1-10 and 20-27; necessary in the 
translating process is a memory). 

As to claim 47, which depends on claim 35, Rueda teaches 

the speech generator generates the speech that summarizes the detected speech (col. 3 
lines 1-10 and 20-27). 
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As to claim 51, which depends on claim 35, Rueda teaches 

wherein the sensor selectively detects a speech necessarily from a specific speech source 
(col. 1 lines 1-10 and 20-27). 

As to claim 113, Rueda teaches 
A prosthetic hearing device (hearing aid, col. 1 lines 56-60) comprising: 
a sensor for detecting a speech (microphone, col. 3 lines 1-10) 

a speech recognition processor that performs speech recognition on the detected speech 
(col. 3 lines 23-26), wherein the speech generator transforms the detected speech in view of at 
least one of a physical state of the user and an operating condition of the prosthetic hearing 
device (col. 3 lines 20-29 and col. 1 lines 52-56, translation purpose) 

an output device (output transducer, Abstract) that outputs generated speech to the user 

a speech generator (speech recognizer and processor, Fig. 1) 

Rueda does not teach a speech generator that analyzes results of speech recognition to 
comprehend a semantic meaning in the detected speech and transforms the detected speech into a 
speech having a speech form assistive in understanding the semantic meaning in the detected 
speech; a memory that has stored a library of images compressing still and motion pictures, 
symbols, characters, notes, photos, animations, illustrations, voice spectrum patterns and colors, 
wherein the speech generator selects at least one image associated with the semantic meaning in 
the detected speech; and a display that displays the selected at least one image associated with 
the semantic meaning in the detected speech. 

However, Takebayashi et al. do teach a speech generator that analyzes results of speech 
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recognition to comprehend a semantic meaning in the detected speech and transforms the 
detected speech into a speech having a speech form assistive in understanding the semantic 
meaning in the detected speech (col. 6 lines 44-50); 

a memory that has stored a library of images compressing still and motion pictures (col. 
18 lines 27-37), symbols (text, col. 7 lines 25-38), characters (text, col. 7 lines 25-38), notes 
(text, col. 7 lines 25-38), photos (animated picture, col. 18 line 33), animations (col. 18 lines 31- 
34), illustrations (human character image, col. 18 lines 35-39), voice spectrum patterns (Fig. 3) 
and colors (col. 25 lines 14-16), wherein the speech generator selects at least one image 
associated with the semantic meaning in the detected speech (col. 7 lines 23-31 and col. 6 lines 
44-50); and 

a display that displays the selected at least one image associated with the semantic 
meaning in the detected speech (col. 7 lines 30-37). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to implement Takebayashi et al. semantic recognition into Rueda's speech generator 
system in order to provide a speech dialogue system for improving human-computer interaction, 
because in conventional speech dialogue system, the speech response is usually given by a 
mechanical voice reading obtained by a text composition without any modulation of speech tone, 
so that it has often been difficult for the user to hear the message, (Takebayashi et al., Abstract 
and col. 2 lines 23-34). 
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Conclusion 



The prior art made of record and not relied upon but considered pertinent to applicant's 
disclosure is listed on the attached PTO-892 

6. Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Myriam Pierre whose telephone number is 571-272-761 1. The examiner 
can normally be reached on 8:30-5:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on 571-272-7602. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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